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(57) Abstract 

The PC based ultrasound system utilizes 
a standard PC central processing unit or CPU 
(an Intel 486 processor or better), standard PC 
memory storage and retrieval components, a 
scan conversion board and a video processing 
board, all disposed and electronically linked 
to the bus in the computer. Additionally, the 
analog drive and return scan video signals are 
sent to and received from a video process- 
ing and motor control unit The video pro- 
cessing and motor control unit is coupled to 
an ultrasound scan lead or probe. The vir- 
tual control user interface for the ultrasound 
system includes a software driven display ob- 
tained from memory. The software driven dis- 
play reveals images representative of hardware 
control configurations for many different ul- 
trasound processors. The images provided by 
the software driven display include: gain con- 
trol tactile user interfaces, image enhancement 
control tactile user interfaces, focus control 
tactile user interface, multiple menu levels for 
gain control, image enhancement, and focus 
controls. In a further embodiment, the virtual 
control user interface is used in conjunction 
with a touch sensitive user input screen and 
the virtual control user interface includes a touch screen input command converter responsive to a user's touch on the touch sensitive dis- 
play monitor to convert the tactile input into software commands. Other features include the ability to recall previously scanned ultrasound 
images, annotate recently acquired ultrasound images, preferably in color, electronically transfer the images to other peripheral computer 
equipment, and display a checklist for medical protocol involved in the ultrasound medical techniques. The medical protocol is loaded as 
pull down or pop up menu available to the user. 
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PC BASED ULTRASOUND DEVICE WITH VIRTUAL CONTROL USER 
INTERFACE 

1 Technical Field 

2 The present invention relates to a personal computer or PC based 

3 ultrasound machine or device with a virtual control user interface. The PC based 

4 nature of the invention permits the user to change boards in the PC component box 

5 to, for example, upgrade his or her machine for use with a wider variety or 

6 different ultrasonic scan heads or probes. The user interface controls the 

7 ultrasound processor, driver and scan head. The invention also relates to a 

8 method which mimics the hardware configuration for other ultrasonic processors. 

9 Background Art 

10 Ultrasound is utilized in many non-invasive medical procedures in order to 

11 detect and diagnosis a patient's condition. For example, ultrasonic scans are 

12 commonly used to detect and monitor the growth, viability and health of fetuses, 

13 to detect and assist in the diagnosis of liver, kidney, and other intestinal ailments, 

14 among others. 

15 During these procedures, an ultrasound transducer head is placed atop or 

16 near the internal organ sought to be scanned. The ultrasonic image (generally 

17 resulting from the detection of sonic echoes by the ultrasonic transducer head) is 

18 displayed in essentially real time on a display monitor. 

19 A significant number of ultrasound machines utilize user interfaces which 

20 are configured as knobs, slide switches, push buttons and other similar type tactile 

21 controls. The user must be trained to simultaneously hold the ultrasonic scan 

22 head on the body of the patient while adjusting the knobs, push buttons and slide 

23 controls on the ultrasound processor while further viewing the display monitor. 

24 A difficulty arises when the physician or medical office wishes to upgrade 

25 the ultrasonic scan head or which is to replace or enhance the ultrasound processor 

26 unit electronically coupled to and driving the ultrasound scan head. In general, 

27 these ultrasound processor units were simply replaced with a larger enhanced 

28 model with a higher level of tactile control knobs, slide switches and push buttons. 

29 Of course^the number of tactile controls available to the user has a physical 



WO 95/15521 



PCT/US94/13624 



2 

1 limitation in relation to the size of the overall processor unit Further, the 

2 physician or medical office is required to train the user of the machine and the 

3 training is unique to a particular hardware and ultrasonic processing technique. 

4 In the past, it has been necessary to purchase an entirely new ultrasound 

5 system if the physician wanted to upgrade his or her equipment Prior art 

6 ultrasound systems normally did not permit upgrades by simply changing the 

7 boards internal to the machine casing. As a result, when technology made prior 

8 art systems obsolete, the physician was required to discard the entire machine, 

9 purchase a new machine and, more likely than not, learn to operate the new 

10 machine. 

11 U.S. Patent No. 4,227,417 to Glenn discloses an ultrasonic device with 

12 dynamic focussing of the ultrasonic transducer. U.S. Patent No. 4,246,791 to 

13 Glenn discloses an ultrasound imaging system with a transducer, a variable delay 

14 circuit and a rotating mirror which directs the sonic pulses and echos to and from 

15 the transducer. U.S. Patent No. 4,248,090 to Glenn discloses a rotating mirror in 

16 a scan or probe head. U.S. Patent No. 4,257,271 to Glenn discloses an oscillating 

17 mirror in a scan head. U.S. Patent No. 4,317,370 to Glenn discloses an ultrasound 

18 system with a single timing circuit which provides clocking signals to both the 

19 frame storage and the oscillatory mirror drive circuitry. 

20 Disclosure of the Invention 

21 It is an object of the present invention to provide a PC based ultrasound 

22 system wherein the system can be upgraded or modified to accommodate new or 

23 different scan or probe heads simply by an exchange of a board within the PC 

24 casing. 

25 It is an object of the present invention to provide a computer based virtual 

26 control user interface for an ultrasound processor and system. 

27 It is a further object of the present invention to provide a virtual control 

28 user interface which incorporates multiple menu levels for the display of gain 

29 control images, ultrasound enhancement control images and focused controlled 

30 images. 
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1 It is a further object of the present invention to provide a virtual control 

2 user interface which can reveal images representative of hardware control 

3 configurations for a number of ultrasound processors. 

4 It is an additional object of the present invention to provide a virtual 

5 control user interface which incorporates a touch screen display monitor. 

6 It is another object of the present invention to provide a virtual control user 

7 interface which can be customized by the user to enhance the operability and 

8 effectiveness of the user interface. 

9 It is a further object of the present invention to provide a virtual control 

10 user interface which includes a pull down or pop up protocol check list or menu 

1 1 which may be used by the user to insure that the ultrasound techniques recorded 

12 by the ultrasound processor comply with a predetermined medical protocol. 

13 It is another object of the present invention to provide an ultrasound 

14 processor which is configured with plug-in boards for a processor unit, 

15 input/output interface or display monitor, a keyboard, and various input/output 

16 interfaces for other peripheral computer equipment 

17 The PC based ultrasound system utilizes a standard PC central processing 

18 unit (an Intel 486 processor or better), standard PC memory storage and retrieval 

19 components, a scan conversion board and a video processing board, all disposed 

20 and electronically linked to the bus in the computer. Additionally, the analog 

21 drive and return scan video signals are sent to and received from a video 

22 processing and motor control unit. This unit is coupled to the scan head or probe. 

23 The virtual control user interface for an ultrasound processor includes a software 

24 driven display obtained from a memory unit in the ultrasound processor and 

25 displayed on a display monitor (part of the ultrasound processor) under control of 

26 a processor unit (which is also part of the ultrasound processor). The software 

27 driven display reveals images representative of hardware control configurations for 

28 other ultrasound processors. These ultrasound processors are electronically coupled 

29 to an ultrasound scan head via a scan head interface unit The images provided 

30 by the software driven display and displayed by on the display include: a plurality 

31 of gain control tactile user interfaces, a plurality of ultrasound image enhancement 
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1 control tactile user interfaces and, at least one focus control tactile user interface. 

2 The software driven display has multiple menu levels for the display of the gain 

3 control images, the ultrasound images enhancement control images and the focus 

4 control image. The software driven display is also further configured to reveal 

5 images of more than one ultrasound processor. In a further embodiment, the 

6 virtual control user interface is used in conjunction with a touch sensitive user 

7 input screen and the virtual control user interface includes a touch screen input 

8 command converter responsive to a users touch on the touch sensitive display 

9 monitor to convert the tactile input into a software command corresponding to the 

10 image proximally displayed on touch sensitive display monitor. Other features of 

11 the control user interface include the ability to recall previously scanned ultrasound 

12 images which are recorded in the memory unit of the ultrasound processor, to 

13 annotate recently acquired ultrasound images, preferably in color, such that the 

14 ultrasound electronic images and associated annotations can be electronically 

1 5 transferred from the ultrasound processor to other peripheral computer equipment, 

1 6 and a checklist for medical protocol involved in the ultrasound medical techniques. 

1 7 The medical protocol is loaded as pull down or pop up menu available to the user. 

18 Brief Description of the Drawings 

1 9 Further objects and advantages of the present invention can be found in the 

20 detailed description of the preferred embodiments when taken in conjunction with 

21 the accompanying drawings in which: 

22 FIG. 1 diagrammatically illustrates one embodiment of the virtual control 

23 user interface main screen; 

24 FIG. 2 diagrammatically illustrates another embodiment of the dynamic 

25 menu portion of the virtual control user interface; 

26 FIG. 3A diagrammatically illustrates the timing gain control (TGC) user 

27 interface in one embodiment; 

28 Fig. 3B diagrammatically illustrates the operation of the touch screen 

29 control sub-system; 

30 FIGS 4A, 4B and 4C diagrammatically illustrate the TGC user interfaces 

31 in another embodiment; 
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1 FIG. 5 diagrammatically illustrates the dynamic menu portion and sub- 

2 menu for the gain control interface; 

3 FIG. 6 diagrammatically illustrates another embodiment of the gain control 

4 secondary menu; 

5 FIG. 7 diagrammatically illustrates a portion of the virtual control user 

6 interface sub-menu for the process or ultrasound image enhancement control 

7 interface; 

g FIG. 8 diagrammatically illustrates a second embodiment for the image 

9 enhancement control user interface; 

10 FIG. 9 diagrammatically illustrates a second embodiment of the dynamic 

1 1 menu window for the process sub-menu; 

12 FIG. 10 diagrammatically illustrates one embodiment of the sub-menu 

13 display for the caliper or measurement user interface; 

14 FIG. 1 1 diagrammatically illustrates another embodiment for the caliper or 

15 measurement control user interface; 

16 FIGS. 12 and 13 diagrammatically represent two embodiments for the 

17 dynamic window display for the accessories or access sub-menu level; 

18 FIG. 14 diagrammatically illustrates the virtual control user interface for 

19 the focus control sub-menu and particularly one scanned image displayed in 

20 conjunction with the user interface; 

21 FIG. 15 diagrammatically illustrates the dynamic menu window for the 

22 focus control sub-menu utilized in conjunction with a second embodiment of the 

23 present invention; 

24 FIG. 16 diagrammatically illustrates the sub-menu level for the orientation 

25 or rotate image menu; 

26 FIG. 17, 18 and 19 diagrammatically illustrate the body marker or scan 

27 region menus and displays in accordance with the principles of the present 

28 invention; 

29 FIG. 20 diagrammatically illustrates the virtual control user interface 

30 showing a pair of ultrasound scanned images, one from an earlier scan and one 
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1 from the current scan wherein these dual scan images are part of the recall sub- 

2 menu; 

3 FIG. 21 diagrammatically illustrates the annotation feature of the control 

4 user interface; 

5 FIGS. 22, 23 and 24 diagrammatically illustrate the system sub-menu, mode 

6 sub-menu and information sub-menu used in conjunction with one embodiment of 

7 the present invention; 

8 FIG. 25 diagrammatically illustrates a system diagram for the ultrasound 

9 processor incorporating the virtual control user interface as well as that processor 

10 being electronically connected to various other computer elements. This figure 

11 also illustrates the interconnectivity of the ultrasound processor .with these other 

12 computer peripheral elements; 

13 FIG. 26 diagrammatically illustrates the PC based ultrasound machine with 

14 a plug-in scan converter board for the PC and a video processor and motor 

15 controller unit as an external unit; 

16 FIG. 27 diagrammatically illustrates a block diagram of the scan converter 

17 board; and, 

1 8 FIG. 28 diagrammatically illustrates the video processing and motor control 

19 unit for one embodiment of the present invention. 

20 Best Mode for Carrying Out the Invention 

21 The present invention relates to a PC based ultrasound system and utilizes 

22 a standard PC central processing unit or CPU (an Intel 486 processor or better), 

23 standard PC memory storage and retrieval components, a scan conversion board 

24 and a video processing board, all disposed and electronically linked to the bus in 

25 the computer. Additionally, the analog drive and return scan video signals are sent 

26 to and received from a video processor and motor control unit which is currently 

27 external to the PC. This external unit is connected to the ultrasound scan head or 

28 probe. The invention also includes a virtual control user interface for the 

29 ultrasound processor and system, a method for establishing and using that virtual 

30 control user interface, an ultrasound processor having a high degree of 

31 interconnectivity with other computer peripheral equipment, and an ultrasound 
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1 processor that is configured with plug-in electronic boards generally similar in 

2 . nature to a personal computer. 

3 FIG. 1 diagrammatically illustrates one embodiment of the computer based 

4 virtual control user interface and particularly the main or primary menu display 

5 screen revealing the first electronic representation of a hardware control panel for 

6 another ultrasound processor. Main menu display screen 10 includes an ultrasound 

7 scan image area 12 (occupying approximately 60-80% of the display monitor) (see 

8 FIG. 25 and the accompanying explanatory text). The main menu display screen 

9 includes nine major regions one of which is the ultrasound scan image area 12. 

10 The second major region 14 is configured at the upper portions of the screen and 

11 includes a program identification area 1 6 (identify the program asJSUPERVISION) 

12 and a probe identification or ultrasound scan head identification region 18. It 

1 3 should be noted that the present invention may be used in conjunction with several 

14 different types of ultrasound scan heads and therefore it may be important to 

15 display the type of scan head currently being utilized by the operator on a 

16 continuous basis during the ultrasound procedure. The upper menu region with 

17 software program area 1 6 and probe Id area 1 8 is generally displayed continuously. 

18 The third screen region 20 includes a date display area 22, a surname or 

19 last name display area 24 (showing the last name of the patient currently being 

20 scanned by the user or operator of the ultrasound processor), the first initial of the 

21 person being scanned 26, the sex of the person being scanned at area 28, the age 

22 of the person being scanned at area 30, and a display region 32 showing the 

23 particular ultrasonic scanning procedure being carried out by the user on that 

24 patient. In general, the information in display screen region 20 is maintained 

25 throughout the ultrasound scan. 

26 Display screen regions 34, 36 and 38 respectively reveal system or 
. 27 equipment configurations (area 34), a dynamic control menu screen region 36, and 

28 a critical function menu or screen region 38. The dynamic menu control panel 36 

' 29 is primarily altered to reveal submenus and increasing detail of user actuatable 

30 controls during the operation of the virtual control user interface. However, other 
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1 changes to the image screen area 12 as well as the help and comment areas A B 

2 in screen region 40 are discussed in detail hereinafter. 

3 The lower menu bar 42 has been left blank in the embodiment illustrated 

4 in FIG. 1. This area can be subject to future development and can be used to 

5 display prompts for function keys or other items which may assist the user in 

6 controlling the processing as well as the operation of the ultrasound scan head. 

7 The last portion of the display screen 10 is the side bar menu display 44 

8 which provides an indication to the user of the color selected on the display 

9 monitor as well as the intensity or gray scale of the image. The user can alter the 

10 gray scale and color scale of the ultrasound image in image area 12 in real time 

1 1 during an ultrasonic scan of a patient simply by touching the -screen or pointing 

12 and actuating a mouse or track ball controlled curser/pointer in these screen 

13 regions. 

14 Preferably, the screen display region 28 reveals a small image of a man or 

15 a woman rather than simply a designation of M for male or F for female. 

16 As discussed in detail with respect to FIG. 25, the displays generally 

17 illustrated in FIGS. 1-24 are shown on a display monitor. The display monitor 

18 may be a common cathode ray tube or other display monitor customarily 

19 associated with computer equipment or may be more sophisticated touch screen 

20 monitor. As is known by persons of ordinary skill in the art, monitors are 

21 available that detect presence or absence of a user's finger on a certain portion of 

22 the screen. This type of display monitor is identified herein as a "touch screen 

23 display monitor." The touch screen display monitors are meant to cover devices 

24 that are capable of displaying various indicia and images as well as providing an 

25 input device for the user to select one or more control functions visually indicated 

26 on the display screen. 

27 As discussed later in conjunction with FIG. 25, the user may select one or 

28 more elements or menu features from the main menu display screen 10 by use of 

29 a cursor directed by a mouse or track ball (as shown in FIG. 1 on the TGC 

30 control) or by use of the tab key or other key stroke combinations. 
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In any event, when the cursor falls within one of the operable menu blocks, 
principally display screen areas 34, 36 and 38, the particular element in that menu 
block lights up or is preliminarily activated such that the user has a visual 
indication of the precise location of the cursor. It should be noted that the 
particular menu and sub-menu for that function has not been activated until the 
user depresses the activation button on the mouse, track ball or strikes the enter or 
return key on the keyboard. For touch type screens, the user must strike the screen 
segment immediately proximate the displayed function. In another embodiment 
discussed in conjunction with EIG. 3B, the user can control a machine function by 
touching or moving the curser to a specific screen region not immediately 
proximate the display function. 

In FIG. 1, the cursor has been positioned atop the TGC or time gain control 
of the ultrasound processor virtual control user interface. The TGC control is lit 
as shown by the illumination lines. When the cursor arrives at a certain menu 
block, help and comments area A (display screen area 40) indicates the english 
language equivalent for that command function. The Comment A Table, which 
is set forth below, provides exemplary comments which would appear in the upper 
portion of display screen area 40. 

Comment A Table 



Cursor Position 


Comment 


TGC 


Time Gain Control 


Gain 


Power-Gain-Reject 


Process 


Select Correct Process 


Caliper 


Measure Between Points 


Access 


Select Peripheral Accessories 


Focus 


Select Focal Points 


Body 


Id Scan Area on Body 


Label 


Annotate Image 



One important feature of the present invention is the ability of the virtual 
control user interface to display in the help and comment area 40 a foreign 
language equivalent for the TGC. Also, another important feature of the present 
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1 invention enables the user to preset certain elements and textual explanatory 

2 material in help and comment area B (display screen area 40) for example, the 

3 control user interface could be pre-programmed such that the user would be 

4 required to select a particular ultrasonic scan medical protocol for adjusting the 

5 TGC or time gain control for the ultrasound scan head. The help and comment 

6 area B could automatically remind the user that he or she must select the 

7 appropriate medical protocol for adjusting the TGC control on the ultrasonic scan 

8 head. 

9 To carry this computer based and computer driven display system one step 

10 further, the virtual control user interface could block access to the subsidiary 

1 1 menus (for example, subsidiary menus in FIGS. 3, 4 and 5) until the user actually 

12 selects a medical protocol. 

13 Further software blocks could added to the virtual control user interface 

14 which would require the user to input the name, age and sex of the patient and 

15 particularly identify the patient number or other relevant information before 

16 conducting an ultrasonic scan. 

17 FIGS. 2, 3, 4A, 4B and 4C diagrammatically illustrate two embodiments 

18 of the subsidiary menu or secondary menu level below the time gain control TGC 

19 user interface. 

20 FIG. 2 diagrammatically illustrates a dynamic menu region 36 and display 

21 screen area 38 which shows icon for the various commands or functions as well 

22 as the english language equivalent or abbreviations for those functions. In general, 

23 there are two different display embodiments discussed herein. These different 

24 embodiments are meant to reveal the flexibility of the virtual control user interface 

25 and not to limit the claims appended hereto. The icon shown in FIG. 2 show TGC 

26 as a vertically oriented curve since the TGC actually changes the sweep of the 

27 echo response generated by the ultraisound scan head, a gain icon which is a 

28 horizontally oriented curve, a process icon as two synchronized wave forms; a 

29 caliper or measurement icon revealed by an illustration of a caliper; protocol 

30 (which may be represented by a book or a note pad indicating which medical 

31 protocol should be selected for a particular ultrasonic scan), an access icon which 
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1 reveals a central box with peripheral units connected from the central box 

2 (representing the ultrasound processor which is electronically connected to certain 

3 access items such as VCR's, CD ROM writers and readers, LANs modems and 

4 linked to enhanced computerized data bases), a focus icon, a rotate image icon 

5 comprising of four arrows outwardly directed from a central square; a body marker 

6 icon shown as a body; a scale or zoom icon illustrated by a magnifying glass; a 

7 recall image or electronic file icon shown as a file folder with an arrow pointing 

8 outbound therefrom, a label or annotation icon illustrated by hand holding a pen 

9 or a pencil which is writing on a note pad. In screen display area 38, icons 

10 representing a freeze image signal (shown as a snow flake), a save image icon 

11 shown as a file with an arrow pointed to the file and a phota icon shown as a 

12 camera. 

13 The freeze function enables the user to take a freeze frame of the 

14 ultrasound image currently retained in the temporary memory of the ultrasound 

15 processor. As can be appreciated, the acquisition of ultrasonic signals occurs in 

16 real time and the ultrasound processor unit continuously receives new electronic 

17 signals from the ultrasound scan head. Once the operator identifies a particularly 

1 8 good image (represented by a multiplicity of electronic signals currently displayed 

19 on the display monitor), the operator can freeze frame that electronic image and 

20 further process that image as discussed hereinafter. The user functions of saving 

21 an electronic image as well as generating a photograph of the electronic image are 

22 fairly well known. Saving an electronic image enables the user to electronically 

23 store the ultrasound scan image into the ultrasound processor memory (discussed 

24 liater in conjunction with FIG. 25) and further to save it into other electronically 

25 attached computer peripheral elements. The photo function is also readily apparent 

26 to users of preexisting ultrasound processors. For example with respect to 

27 obstetrical ultrasonic techniques, physicians may want a printed image of the 

28 frozen or selected electronic image captured by the ultrasound processor. The user 

29 can select the photo function and a polaroid type photograph is generated by the 

30 ultrasound processor or an appropriately configured peripheral equipment 
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1 FIGS. 3A and 4A, 4B and 4C diagrammatically illustrate a secondary menu 

2 level associated with the TGC or time gain control virtual control user interface 

3 in accordance with the present invention. FIG. 3A, only the TGC functional 

4 element has been illustrated. Since the TGC or time gain control of the ultrasound 

5 processor affects generally the depths and echo responsiveness of the ultrasound 

6 scan head, users are generally accustomed to moving a plurality of slide switches 

7 or rotating a plurality of knobs to adjust the image and the depth of the image 

8 displayed in image area 12. In FIG. 3A, the virtual control user interface is 

9 configured with a plurality of user activatable slide or bar switches 60a, 60b, 

10 among others. To change the TGC at the upper level of scan image (for an 

1 1 illustration of the scan image, please refer to FIG. 14), the user would locate the 

12 cursor on the virtual image for slide bar 60a, click the mouse or actuate the push 

13 button on the track ball, drag the virtual image of the slide bar 68 to another point 

14 on virtual image track 62a and then release the mouse switch or track ball switch. 

15 Alternatively, a touch type display screen is utilized, the operator could simply 

1 6 touch the virtual image of slide bar 60a and move the slide bar along virtual image 

17 line 62a to the appropriate position. Simultaneous with this change, the 

18 sonographic image in image area 12 is changed. Accordingly, the virtual control 

19 user interface in the present invention not only changes the ultrasonic image 

20 captured by the processor but also acts as a control mechanism to control the 

21 response of the ultrasonic scan head. Immediately adjacent each virtual image 

22 slide bar control line 62a, 62b, is a display area showing the numerical value. 

23 Please refer to display 64a and 64b. To show the flexibility of the virtual control 

24 user interface, the user could save a particular screen setting or TGC screen setting 

25 using the save function. See menu bar area 38 in FIG. 2 or that same area in FIG. 

26 1. Thereafter, the user could recall that TGC or gain setting for feature scans. 

27 FIG. 3B illustrates the concept that the touch screen is utilized to control 

28 the slide bar or TGC controls. Of course, the touch screen control sub-system 

29 described herein for the TGC controls can be used for other types of controls, i.e., 

30 the gain control. In this embodiment, the touch screen is divided into sectors or 

31 predetermined regions which overlap the ultrasonic image area. In FIG. 3B, these 
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1 sectors are horizontal bars. When the operator touches a point on the active 

2 portion of the screen, for example point XI, the screen software routines generate 

3 a screen or a mouse event The same commands are generated by the software if 

4 the mouse pointer is placed at position XI and the mouse control is depressed. 

5 Similar responses are provided with a track ball. Upon generation of the screen 

6 event at position XI, the software locates that position with a digital positioning 

7 data. If the user moves his or her finger across the screen in band X 

8 (encompassing positions XI and X2), the touch screen software generates a series 

9 of values which collectively represent the differential between positions XI and 

1 0 X2. The virtual control program subject to the present invention then converts this 

11 differential into a slide movement of the TGC control bar from position dXO to 

12 position dXn. Concurrently, the TGC control program generates a TGC command 

13 signal to the internal scan converter and the external video processor unit which 

14 alters the TGC control signals at that depth in the return sonic wave, i.e., the sonic 

15 echo. If the user moves from position X2 to position Yl, band Y activates and 

16 the system activates the TGC control associated with the Y band. Finger 

17 movement from position Yl to Y2 changes the TGC control commands to the scan 

18 board and video processor unit as well as the displayed position of the slide bar 

19 in band Y. The slide bar moves from position dYO to dYm. Position points Zl 

20 and AA1 fall in bands Z and AA. The bands are not displayed to the user, they 

21 are invisible. However, the user can select any control simply by touching the 

22 screen. The Touch Control Table which follows is an example of this feature of 

23 the invention. 
24 
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1 Touch Control Table 

2 Finger Band Sereen TGC-SCN Knob 

3 Position Event 
4 

5 xl x activate dxo 

6 x2 x move xl to x2 dxo + (x2-xl) dxn 

7 yl y move x2 to yl — dyo 

8 y2 y move yl to y2 dyo + (y2-yl) dym 

9 zl z — — 

10 AA1 AA - 

1 1 The flexibility of the present invention is also illustrated by reviewing the 

12 sequential figures of FIG. 4 A, 4B and 4C. In these figures, slide bar switches 60a 

13 and 60b are illustrated immediately adjacent the line representation of the signal 

14 generated by the ultrasound scan head. This is shown in graphic region 65. FIG. 

15 4B illustrates that the cursor has been placed proximate virtual image of slide 

16 switch 60g and that slide switch has been changed to reduce the gain at that 

17 particular vertical location. Slide switched 60g and 60h have been changed and 

18 the height of curve 67 has been changed is noted by a comparison between FIGS. 

19 4Aand4B. 

20 The control user interface is shown in FIGS. 4 A, 4B and 4C also include 

21 gain control slide switches 66 as well as smoothing function slide images 68. In 

22 comparing FIG. 4A and FIG. 4C, the smooth switch 68 has been changed and 

23 curve 67 is shown as distinctly linear as compared with the curves shown in FIGS. 

24 4A and 4B. Of course, the actual virtual control user interface can be altered to 

25 include a larger number or a smaller number of slide switches then illustrated in 

26 FIG. 4 or FIG. 3 A. Also, when the sophistication of the ultrasound scan head 

27 improve, the user can simply replace the scan head interface unit (discussed in 

28 conjunction with FIG. 25), update the virtual control user interface software 

29 (illustrated in conjunction with FIGS. 1-24) without having to completely discard 

30 the ultrasound processor. Further, improvements in the control user interface can 

31 be easily adopted through the use of the software driven display modules 
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1 illustrated herein. The software driven display module can be easily changed as 

2 compared with the hardwired or hardware control configurations for other 

3 ultrasound processors. 

4 FIGS. 5 and 6 diagrammatically illustrate the secondary level associated 

5 with the gain function. FIG. 5 illustrates the use of virtual images of control 

6 knobs which the user may be accustomed to for a given hardware control 

7 configuration for another type of ultrasound processor. FIG. 5 illustrates that the 

8 user has activated the gain function from the main menu (see FIG. 1 and 2) and 

9 the dynamic menu window 36 now reveals virtual images for the control knobs 

10 controlling the power (area 70) and the gain, area 72, and the reject signal control 

1 1 area 74. With respect to virtual image power area 70, a knob- 76 is illustrated. 

12 Knob 76 has a virtual image line indicator 78 as well as red color danger areas 80. 

13 The red color danger areas are in a partial arcuate ring beginning at approximately 

14 60% of total power level. The power level virtual display also includes a 

15 numerical display 82 which reveals to the operator of the actual power percentage 

1 6 level generated by the ultrasound scan head. The gain menu area 72 and the reject 

1 7 menu area 74 are similarly configured with virtual images of control knobs as well 

18 as those knobs indicating overload or danger areas indicated in red or other 

19 distinctive display colors in an arcuate band about the central rotative position. 

20 If a touch type screen is utilize, the operator would touch the radial end of 

21 lineal position marker 78 (see power menu area 70) and move his or her finger in 

22 a clock wise or counter wise manner about a pivot point generally in the center of 

23 the virtual control panel. 

24 FIG. 6 diagrammatically illustrates another virtual control panel for the gain 

25 wherein the virtual knob controls include protruding virtual tabs 84, 86 and 88. 

26 If a touch type display screen is utilized, the operator would simply touch virtual 

27 knob 84, 86 and 88 and rotate his or her finger clock wise and counter wise about 

28 a central pivot position one of which is pivot position 90 for power knob 92. 

29 Also, FIG. 6 diagrammatically illustrates danger zones as shaded areas around the 

30 virtual knobs. One of these danger zones is shown as danger zone 94 around 

31 virtual knob 92, the virtual power control. FIG. 6 also illustrates a further 
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1 functional aspect a "set and leave" command area that may be selected by the user. 

2 Once selected, the user can exit the sub-menu for the gain control. Another way 

3 the user can exit a particular sub-menu is to simply move the cursor beyond the 

4 dynamic window and actuate the control button on the mouse or the track ball. 

5 FIGS. 7, 8 and 9 illustrate various embodiments for the process sub-menus. 

6 One embodiment is shown in FIG. 7 wherein the dynamic display window 36 

7 illuminates the process functions and shows various options available to the user 

8 to control the processing of the ultrasonic electronic signals obtained from the 

9 scanhead. This processing includes changing the pallet on the image displayed in 

10 image area 12, changing the photographic pallet or color mix, changing the 

11 dynamic range for the scan signals, changing the automatic gain control (AGC) 

12 range and the speed or timing function for AGC enhancing the edge detection of 

13 the scan signal and providing time integration for the scan signal. As noted 

14 earlier, when the user moves the cursor over one of these areas, for example, 

15 image pallet as compared with dynamic range, that particular menu selection is 

16 highlighted or lights up. If the user wishes to activate that particular function, the 

17 user clicks the mouse button or tracking ball button or, in a touch screen situation, 

18 touches the screen :to actuate the third menu level. 

19 In the process menu, the image area is some what reduced and a pop up 

20 virtual control interface is displayed in lower region 110. As shown in FIG. 7, 

21 this virtual control interface consists of a number of slide switches n x through ^ 

22 which can be actuated or moved by the user simply by placing the cursor on one 

23 of the virtual images of the slide bar and dragging the slide bar to the appropriate 

24 lineal position as indicated by the lines associated with each slide bar. As a 

25 further development, the actual power level or number could appear in the interior 

26 of the slide bar box. For example, n, could display 10% as being the image level 

27 for that particular range. 

28 FIG. 8 diagrammatically illustrates another configuration for the process 

29 controls using a plurality of slide switches 112 two of which are shown as slide 

30 switches 1 14 and 116 which control the timing gain of all the signals as well as 
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1 the smoothness characteristic of the video scan processor. This virtual control 

2 feature is diagrammatically illustrated above in conjunction with FIGS. 4A-4C. 

3 FIG. 9 diagrammatically illustrates dynamic menu window 36 showing the 

4 process sub-menu activated and indicates sub-level user control commands to effect 

5 image pallet, photo pallet, dynamic range, AGC range and speed, edge 

6 enhancement and time integration. 

7 FIGS. 10 and 11 diagrammatically illustrate the caliper sub-menus which 

8 relate to measurement functions available to the user via the virtual control user 

9 interface. FIG. 10 shows that dynamic menu window 36 includes an illuminated 

10 caliper button as well as reveals function buttons for measuring lines, measuring 

1 1 circumference, measuring area and measuring volume. Further^a function button 

12 enabling the user to clear a particular line is found in dynamic window menu 36. 

13 FIG. 11 shows a slightly different configuration with a cursor 118 proximately 

14 adjacent distance function button 120. . Dynamic window 36 displays distance 

15 figures in region 122 (shown in red between the small plus signs in image area 12, 

16 the yellow distance shown between X's in image area 12, and a green distance G 

17 shown by asterisks in image area 12). The green line is illustrated on the image 

18 in a green color and is shown in green in display region 126. In the screen area 

19 128, an image area is illustrated in magenta (M) and is highlighted in that color 

20 in image area 12. In the lower menu region 42, the red distance, yellow distance 

21 and green line distance is shown in order to assist the user. 

22 The ability of the user to mark and measure the distance on a sonographic 

23 electronic image is important For example, when using an ultrasound technique 

24 in conjunction with fetal development, the obstetrician seeks information regarding 

25 the length of certain fetal limbs as apparent in the ultrasonic electronic image. By 

26 enabling the user to easily control the processing of this ultrasound image (through 

27 TGC and gain virtual controls) and enabling the user to freeze that ultrasonic 

28 image on the screen (see for example FIG. 2, menu region 38 and the freeze 

29 control therein), the user can easily mark the image and actually make electronic 

30 drawings and immediate measurements for the physician and other health 

31 professionals interested in this information. The use of different colored lines and 
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1 different display significantly enhances the operability and the user friendliness the 

2 present system. 

3 FIGS. 12 and 13 diagrammatically illustrate the access or accessory sub- 

4 menu for two embodiments. FIG. 12 shows menu buttons for electrocardiograph 

5 information (ECG) virtual menu button 130, phonographic or audio acquisition and 

6 access to other peripheral equipment on menu button 132, access to a camera 

7 peripheral equipment on virtual button 134 as well as access to a video tape 
S recorder or VCR on menu button 136. 

9 With respect to FIG. 13, other accessories are available such as a printer 

10 or a modem/facsimile machine. The preferred virtual control user interface 

1 1 incorporates a toggle on or toggle off type switch. However, as shown in FIG. 13, 

12 it may be appropriate to list the availability and on line accessibility of this 

13 equipment through various electronic computer ports. 

14 With respect to FIG. 12, the photographic or audio linkage could be in the 

1 5 case of obstetrical use, the linkage of sounds obtained from a fetal monitor as well 

16 as the sonographic electronic file information. If this information from the audible 

17 fetal monitor as well as the electronic image from the sonogram taken of the 

18 pregnant mother is transferred to a specialist, the specialist at a very remote 

19 location could assess the condition of the mother by reviewing this information at 

20 his or her leisure. The ability to electronically obtain these signals, log these 

21 signals in and out of the system and store them in an electronic file as well as 

22 transfer this electronic file to others is an important feature of the present 

23 invention. 

24 FIGS. 14 and 15 diagrammatically illustrate the sub-menu levels for the 

25 focus control virtual function. In FIG. 14, an ultrasonic scan signal is illustrated. 

26 The focus virtual control button has been illuminated. Display areas 210, 212, 214 

27 and 216 reveal the multiple focus points available to the operator. Particularly, 

28 focus points 1, 2 and 3 are on and the tissue depth is illustrated for each focal 

29 point. Focal point 4 is off. Arrows a, b and c correspond to focal points 1, 2 and 

30 3 and as displayed as such, the operator can change, for example, focal point 3, 

31 arrow c, by moving the cursor to arrow c and dragging arrow c to a point all the 
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1 way to the top of the screen or at level 218 or all the way to the bottom of the 

2 screen at level 220. It should be noted that the illustrated ultrasound image is only 

3 exemplary in nature and may actually fills the entire image area 12. Also, it 

4 should be noted that the operator can drag any of the focal points beyond the other 

5 focal points already fixed. 

6 FIG. 15 illustrates and alternative embodiment for the dynamic display 

7 window region 36. Focus button 230 has been illuminated and the operator has 

8 turned on focal points 1, 2 and 3 but focal point 4 is off. 

9 FIG. 16 diagrammatically illustrates the rotate image or orientation menu 

10 level such that rotate menu button 232 is illuminated. One virtual control interface 

1 1 could include the use of horizontal and vertical lines 234 and 236 each having an 

12 arrow head at opposing ends. Function buttons d, e, f and g may be placed at the 

13 terminal ends of those arrow heads. In a touch screen user interface, the user can 

14 simply touch display button d and move it up or down thereby moving the image 

15 238 up or down or otherwise rotating the image clock wise or counter clock wise 

16 by simply rotating button d in the appropriate manner. Image 238 is rotated 180° 

17 as shown by image 238i in dashed lines in FIG. 16. 

18 FIGS. 17, 18 and 19 diagrammatically illustrate the body marker or scan 

19 position virtual control user interface for the present invention. In FIG. 17, the 

20 body marker menu button 250 is illuminated and the operator can select from this 

21 sub-menu an image view 252, an icon placement function 254 and a probe 

22 placement function 256. As shown in FIG. 17, a rectilinear image block 260 has 

23 been placed on the left hip region of the female image. This indicates that the 

24 user has scanned that general region of the patient FIG. 18 diagrammatically 

25 illustrates front and back views of a male as user markable icons 272 and 274. 

26 FIG. 19 is a further menu selection enabling the user to select a particular scan 

27 icon such as by selecting rectilinear bar icon 276, Y bar icon 278 or arrow head 

28 icon 280. Function command 282 enables the user to rotate the particular scan 

29 icon along the body icon 290 or 292. In this illustrated embodiment, the body 

30 icons are provided with a plurality scan positions generally illustrated as a plurality 

31 of arrow heads 294 directed to the right side of the front of the female body. Of 
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1 course, the virtual control user interface may have a plurality of arrow heads 

2 pointing and surrounding the body icons. In this embodiment, the user would 

3 select the appropriate position icon by positioning the mouse or track ball curseir 

4 on the particular body position icon and selecting the position elements by 

5 depression of the mouse or track ball key. Also the user can select the type of 

6 scan icon used at that body location. The program would then locate the selected 

7 ( scan icon at the selected body location. The user would also be able to rotate that 

8 scan icon to the appropriate position. This is shown with respect to body icon 292 

9 wherein rectilinear scan icon 296 has been positioned at the lower back of body 

10 icon 292. The scan number has been displayed in display region 298. In the 

11 lower region 299, the operator is reminded of the current scan number which 

12 should be identified in conjunction with the ultrasonic scan acquired by the 

13 operator. 

14 The body marker and various secondary and third menu sub-levels may be 

15 particularly helpful when used in conjunction with protocol function. In other 

16 words, the user may select a particular protocol from the protocol function menus 

17 and then call up the body marker in order to assist the user to properly scan the 

18 correct area on the patient Simultaneous with this scanning and acquisition and 

19 signal processing by the user, the virtual control user interface could prompt the 

20 user to scan certain positions on the patient. This prompting could be incorporated 

21 as part of the body marker menu function. 

22 The following protocol table illustrates the potential of the protocol menu 

23 function button (see FIG. 2). In the Protocol Menu Table which follows, the basic 

24 protocol for determining a certain kidney condition includes pelvocaliceal scans in 

25 multiple positions. 
26 
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1 Protocol Menu Table 

2 A. Basic Protocol 

3 Outline Kidney 

4 Pelvocaliceal Scan Echo 

5 Position 1 ; 

6 (move 5 cm) 

7 Position 2 

8 (move 5 cm) 

9 Position 3 - 

10 B. Supplemental (Baker) Protocol 

11 C. Dr. Kelly's Protocol 

12 The protocol menu function could be coupled with the body markers in 

13 order to require the user to scan a minimum of three positions in order to f ulfill 

14 the basic protocol. Upon storing and filing the three scans (using the save menu 

15 function button (FIG. 2)), the user would check off each element in the basic 

16 protocol. As stated in the protocol menu table, the user would be required to 

17 outline the kidney, and scan the enteral body organ in three positions as 

18 specifically stated in the protocol. 

19 If the physician ordering the sonogram wanted to use a different or a higher 

20 level protocol, the physician or other medical technician could load in this other 

21 protocol (the Baker protocol) and the Baker protocol could be listed for the user. 

22 Further, in some instances different doctors in the same medical office may want 

23 scans at different levels or at different frequencies. The protocol menu function 

24 button could provide this. 

25 FIG. 20 diagrammatically illustrates the recall virtual control user interface. 

26 In the recall function, menu button 410 is illuminated and image display area 12 

27 is divided into two sections, the first section showing a current scan (identified 

28 with the current date) and an earlier scan image identified by showing scan date 

29 M. In the illustrated instance, the user has selected menu button 412 show 

30 current date N and the earlier scan image of scan date M at function 414. The 

31 user has the ability to call up other scans, particularly those acquired at date L, 
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1 date K and date J. With this feature, the user could configure electronic files 

2 showing the progression or regression of a certain disease. 

3 FIG. 21 diagrammatically illustrates the sub-menu level for the annotate or 

4 label menu function. In this instance, the label or annotate menu button 420 is 

5 illuminated and dynamic menu display area 36 shows functional buttons for 

6 applying red labels, yellow labels, selecting the size of the print (which is 

7 commonly known as font size), as well as a paint ON or paint OFF function 

8 button 422 and a clear function button 424. In the display image area 12, the 

9 physician has circled a region 426 in, for example, a red color and has typed the 

10 term "possible tumors growth" in order to highlight this region for other health 

1 1 care professionals. In contrast to this red annotation on the electronic scan image 

12 is a yellow annotation "what's this" and a line leading to a certain electronic image 

1 3 region on the ultrasound scan. This different color annotation is identified in FIG. 

14 21 with a double line. Also, the font size has been increased in text region 428 

15 as compared with text region 430. 

16 The annotations may be electronically stored in a separate file or maybe 

17 electronically stored in conjunction with the scanned image. If stored with the 

18 scan image, it may be necessary to enable the user to remove the annotations prior 

19 to viewing. For example, with respect to the recall function shown in FIG. 20, it 

20 may be preferable to remove the annotations from the recall image scan and to 

21 view the image scan side by side without any annotations. Also, it might be 

22 important to include in FIG. 20 the ability to recall in the annotations in the 

23 previous scan with a toggle on or toggle off menu button. 

24 FIGS. 22, 23 and 24 diagrammatically illustrate certain overall features 

25 systems associated with menu bar 34 from the main menu. In FIG. 22 the system 

26 menu has been illuminated and the user is required to input his or her password 

27 or user Id in space 510, is required to set the video connection to NTC or PAL in 

28 section 512 and 514 and also to establish the size of the screen in display box 516. 

29 In order to enhance the user interface, the virtual control user interface may 

30 provide menu selections for the operator to select one of a plurality of selections 

31 to set up the system conditions. Menu box 518 enables the user to diagnosis and 
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test the ultrasound processor as well as the ultrasound scan head and scan head 
interface unit 

In FIG. 23, the mode function button 610 has been actuated and therefor 
illuminated. In dynamic menu area 36, the operator can select which mode the 
ultrasound scan head is operating in, that is, b-mode, n-mode, b mode and m 
mode, b mode and doppler, color doppler, spectrum analysis (involving a 
frequency analysis of the scan signal) or transcranial doppler mode. Of course, the 
virtual control user interface can be modified in the event other ultrasound scan 
heads and general processing routines become available to the user. 

In FIG. 24, the information or info menu button has been selected from 
menu bar 34. Further, menu bar 34 indicates that mail has been received by the 
ultrasound processor in spot 710. The information displayed in image area 12 
provides general instructions for the user, for the renal transplant scan. This is 
somewhat similar to the protocol but really provides a mail box type environment 
where the user is instructed to use a certain type of ultrasound scan head and 
request certain scans such as length, width and depth as well as to send certain 
electronic files to physicians for their further input Dynamic menu area 36 shows 
other available routine such as patient information, procedure information 
(currently displayed in image display area 12) protocol information, appointments, 
measurements, leave a message (for electronic mail) and supervision notes. 

Returning to the main display menu in FIG. 1 and particularly the zoom 
or scale function button, the user, upon actuation of that function, can select the 
degree of magnification or complete enhancement of the scan image appearing in 
image area 12. 

FIG. 25 diagrammatically illustrates the hardware for the ultrasound 
processor 810. In one embodiment, ultrasound processor 810 includes an enteral 
bus 820 connecting a peripheral input/output card 822 with a modem card 824, a 
small computer system interface (SCSI) 826, a mother board 828, an ultrasound 
scan head interface card or unit 830 and a local area network input/output card 
832. Mother board 828 includes random access memory or RAM 834 as well as 
a CPU or central processing unit chip 836. The CPU chip controls the handling 



WO 95/15521 



PCT/US94/13624 



24 

1 of information and instructions on enteral bus 820 the ultrasound scan head 

2 interface unit 830 is connected to an ultrasound scan head 840 as well as to a 

3 photograph production unit 842. The SCSI board 826 is connected to a CD read 

4 and write player 844. Modem 824 is connected via the telephone company 846 

5 to a data base computer file 848. Computer peripheral input/output board 822 is 

6 connected to a local printer 850, a display monitor 852 (which may be a touch 

7 screen monitor) to a mouse 854 as well as to a keyboard 856. Keyboard 856 may 

8 additionally have a track ball 858 thereon. 

9 The local area network input/output board 832 is connected to a file server 

10 860 which in turn is connected to computer system D rl computer system D rt as 

1 1 well as telephone company 862 and a further computer system.D r3 file server 860 

12 is also connected to remote printer 864. 

13 An important aspect of the present invention is the ability to interconnect 

14 the ultrasound processor electronically to other computer data base files (data base 

15 files 848 via telephone company 846 and modem 824) as well as CD read-write 

16 units 844 in order to provide the user with the ability to quickly update any 

17 protocol and share the medical information provided by the accumulation of 

18 scanned data. 

19 In the event the physician or the medical office wishes to up grade its 

20 ultrasound processor, the processor is simply disassembled and one of the cards is 

21 removed while another card is replaced. For example, the physicians may want 

22 to upgrade CPU 836 from a 486 machine to a PENTIUM or 586 type machine. 

23 This can be accomplished simply by removing mother board 828 and installing a 

24 faster mother board. Mother board 828 is further connected to a floppy drive 870, 

25 a hard drive 872, and a magnetic tape 874. 

26 Further, since the electronic images can be annotated and protocol 

27 established and made uniform throughout the entire medical office, the physician 

28 or other medical technician may share this electronic file with other physicians at 

29 computer systems D rl and D n and even medical offices at very remote locations 

30 such as D r3 . In addition, the billing procedure for recapturing the cost for the 

31 ultrasound scans are easily enhanced. For example, the file server 860 can 
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1 periodically poll ultrasound processor 8 1 0 in order to obtain information regarding 

2 the number of scans and the type of scans obtained on that processor. Further, 

3 with the integration of the present ultrasound processor system in the surgical 

4 arena, the current and earlier ultrasound electronic images could be delivered 

5 directly to the operating room such that the physician or surgeon conducting an 

6 operation can visually perceive the progression or regression of a particular disease 

7 or abnormality in a patient during the operation. Further, the surgeon can see 

8 critical areas like blood vessels, urethrae, etc. 

9 In one embodiment, the present virtual control user interface utilizes a 486 

10 INTEL processor with approximately 1-2 mega bytes of RAM. Now, the system 

11 uses 4-8 bytes of RAM. 

12 FIG. 26 diagrammatically illustrates a block diagram of the PC based 

13 ultrasound system 1 100. This system includes a PC case which encloses various 

14 plug-in type PC boards. For example, the illustrated system includes a network 

15 board 1104 which connects to a local area network or LAN, a communications 

16 board 1102 linked to common peripheral equipment such as printers, keyboards 

17 and monitors, a modem 1 108, a SCSI board 1110 connected to a CDROM player, 

18 a mother board 1 1 12 with a CPU and a RAM, a video board 1 114, and a scan 

1 9 conversion board 1116. In the illustrated embodiment, the video board is a Matrox 

20 MARVEL II realtime MPEG audio and video decoding board. This video board 

21 provides live video in a window on the screen, analog to digital conversion of the 

22 video images, realtime frame capture and processing and a digital video expansion 

23 bus. Also, the PC system includes conventional memory units 1118 which include 

24 removable floppy disc drives, hard drives and possibly removable tape drives. 

25 The virtual control user interface controls the plug-in video board in a 

26 manner that is conventional. However, it is unique to the present invention to 

27 process an ultrasonic video image by the video board in conjunction with virtual 

28 user controls. For example, commercially available video boards can rotate a 

29 video image without significant difficulty. However, rotation of an ultrasound 

30 video image under the control of a virtual control user interface with a 

31 commercially available video board is unique. The integration of commercially 
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1 available, plug-in, PC based components permits a much greater flexibility to the 

2 user and operator, 

3 The scan converter board is connected to the video board by a cable which 

4 carries the standard formatted video signal partially processed by the video 

5 processors in external unit 1120 (discussed later) and the scan converter board 

6 (also discussed later). The video board 1114 may be connected to a video display 

7 monitor (not shown). Alternatively or in addition thereto, the video board 1 1 14 

8 is connected to a video player and recorder (a VCR). This connection permits the 

9 user to record and play back ultrasonic scans. With the playback feature, the user 

10 can post-process the ultrasound video image. This post processing is important if 

1 1 the video signal and resulting data may be shared between physicians, particularly 

12 experts in their fields. By permitting easy post-processing of the video image and 

13 potential capturing of the post processed image on the CDROM or the hard disc, 

14 the user can electronically ship the image to a specialist, have the specialist post- 
15 process the image or images, and then receive the post-processed image back into 

16 the ultrasound machine. This post-processed image can then be stored as a 

1 7 protocol to be later called up by the user during subsequent ultrasonic scans of the 

18 same or different patients. The use of an off-the-shelf, commercially available 

19 video board to pre and post scan process the ultrasonic image enables the 

20 electronic image to be stored in a commercially recognized format, be 

21 electronically transmitted, subsequently processed and returned to the originator 

22 without significant difficulties. 

23 In addition to the PC encased components, the present embodiment of the 

24 system includes a video processor and motor controller device or unit 1 120. Unit 

25 1 120 is connected to the scan converter. The video processor and motor controller 

26 drives and pre-processes raw scan video signals from the probe or scan head 1 122. 

27 In another embodiment, the video processor and motor control unit 1 120 will be 

28 encased within the PC box. 

29 If the owner of the present ultrasound system wants to upgrade the system, 

30 he or she can use telephone lines to upgrade the control software, to upgrade the 

3 1 protocols for standard or customary ultrasonic scans, or simply remove and replace 
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1 one or more boards in the PC case. Boards 1 104, 1 106, 1 108, 1 1 10, 1 1 12, 1 1 14 

2 and 1116 are all plugged into the PC's main communications and control bus 

3 1102. 

4 FIG. 27 diagrammatically illustrates the scan converter board. Scan 

5 converter board includes an input timing generator 1202 and an output timing 

6 generator 1204. CPU or central processing unit 1206 may be on the video scan 

7 board or the main CPU could be utilized to generate control CTL-1 and control 

8 CTL-2 signals to timing generators 1202 and 1204. The input timing generator 

9 1202 develops a write enable signal WR-EN for a frame buffer 1208. Output 

10 timing generator 1204 generates a read enable RD-EN for frame buffer 1208. In 

1 1 addition, the analog return scan video signal is applied to an analog to digital * 

12 converter ADC 1210. The digital representation of the scan video is applied to the 

13 input of frame buffer 1208. Frame buffer 1208 is a memory device which 

14 captures a significant portion of the scan video output by the scan head. The 

15 frame buffer formats the raw video signal into a common video format 

16 The output of the frame buffer 1208 is applied to the digital to analog 

17 converter DAC 1212. The analog version of the resulting signal is feed to the 

18 video board shown in FIG. 26. 

19 In addition to the write enable signal for the frame buffer 1208, the input 

20 timing generator 1202 develops a main bang timing control signal which is applied 

21 to the video processor and motor control unit. This main bang time control signal 

22 provides a timing signal to release the voltage burst which activates the transducer 

23 in the scan head to develop the ultrasound signal. After the sound wave is 

24 generated, the transducer is monitored and begin receiving the echo. This echo is, 

25 after some processing by the video processing unit, applied as analog return scan 

26 video into ADC 1210. 

27 In addition, the scan converter board includes a timing gain control or TGC 

28 RAM unit 1220. The main bang time control signal is applied to the TGC RAM 

29 1220. In addition, the virtual user control software applies a TGC-screen (TGC- 

30 SCN) signal to TGC RAM 1220. The TGC RAM 1220 can develop a ramp, a 

3 1 wave, or other type of gain control based upon the TGC-SCN signal developed by 
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1 the virtual control user interface. The signal identified as 1222 shows one type of 

2 TGC control signal. The output of TGC RAM 1220 is applied to a digital to 

3 analog converter DAC 1222. The output, in analog form, is the TGC control 

4 which is fed to the video processor and motor control unit. 

5 In addition to the forgoing, the scan converter board includes a timing gain 

6 RAM 1230 which receives as an input from the virtual control user interface 

7 software a gain/screen command gain-SCN. The output of gain RAM 1230 is 

8 applied to a digital to analog converter DAC 1232. The analog version of that 

9 overall gain control G-CTL is applied to the video processor and motor control 

10 unit Additionally, the virtual user control develops an on/off screen command 

1 1 which is applied as a motor on/off signal. 

12 The TGC RAM 1220 must be timed to the main bang time control signal 

1 3 because the TGC control is utilized to increase the gain in the video processor unit 

14 based upon the time of receipt of the waves of echo indicating different depths in 

15 the ultrasound scan field. 

16 The frame buffer RAM 1208 accepts only a certain portion of the scan 

17 video based upon the write enable signal from input timing generator 1202. The 

1 8 frame buffer 1208 must accept only a part of the scan video because only a portion 

19 of that video signal is actually representative of the ultrasound scan. In other 

20 words, the return echo from the scan head includes all the output data from the 

21 transducer in the scan head. Only a small portion of the transducer's output data 

22 is truly representative of received ultrasonic echo signals. For example, a scan 

23 head that utilizes a rotating mirror will only generate "appropriate" ultrasonic echo 

24 data signals during a certain accurate swing of the mirror. The write enable 

25 control captures this arcuate swing data. Further, the frame buffer 1208 outputs 

26 video information based upon the read enable control from output timing generator 

27 1204. The Frame Buffer Table set forth below gives an example of such an 

28 operation. In the Frame Buffer Table, lines 4-48 are captured by frame buffer 

29 1208. Upon receipt of the read enable command from timing generator 1204, 

30 frame buffer 1208 outputs video signals in a standard video format (e.g., 262 lines 

31 per field) to DAC 1212. In other words, a video conversion is made in frame 
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1 buffer 1208. Alternatively, the read enable signal can be utilized to output only 

2 j a small portion of the captured scan video signal. 

3 Frame Buffer Table 

4 Input WR-EN RD-EN 

5 Line 

6 1-1 0 

7 2 0 

8 3 « . 0 

9 4 1 ConvertsL4-L48 

10 to 262 lines per 

11 . . . -- field 
12 

13 

14 45 1 

15 46 1 

16 47 1 

17 48 . 1 

18 49 0 

19 50 0 
20 

21 . 
22 

23 . . 

24 358 0 

25 359 0 

26 360 0 

27 1-2 0 

28 2-2 0 

29 3-2 0 

30 4-2 0 
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1 Since only a portion of the raw scan video is utilized, it is necessary to 

2 identify the position of the motor rotating the mirror or the transducers in the scan 

3 head. A motor sequence signal is input into input timing generator 1202. This 

4 motor sequence signal is obtained from a transducer attached to the motor in the 

5 scan head. Accordingly, the input timing generator 1202 has some indication 

6 where the motor is located or when a certain portion of the motor has passed a 

7 pre-determined point This provides a timing sequence to trigger the input timing 

8 generator. 

9 FIG. 28 diagrammatically illustrates the video processor arid motor 

1 0 controller unit. The scan converter board delivers main bang time control signals, 

1 1 TGC control signals and gain control signals to video processor *nd motor control 

12 unit 1302. The main bang time control signal is a timing pulse that is applied to 

13 pulser 1304. Pulser 1304 develops a significant but short voltage or current pulse 

14 identified by signal 1306. This signal is applied to the transducer in the scan head. 

15 The transducer is diagrammatically illustrated in this figure as transducer 1308. 

16 The transducer generates a sonic pulse diagrammatically illustrated as pulse 1310. 

17 Since the transducer is also a receiver, pulse 1310 also represents the 

18 received echo from that ultrasonic ping. Therefore, transducer 1308 upon receipt 

19 of the echo 1310, develops an electrical representation of that echo. An isolation 

20 circuit 1312 isolates the driving voltage pulse 1306 and passes the received echo 

21 representation to pre-amplifier 1314. The output of pre-amplifier 1314 is passed 

22 to video processor 1316. Video processor 1316 also receives the analog versions 

23 of timing gain control TGC-CTL and gain control CTL signals from the scan 

24 converter. The video processor 1316 outputs the analog return scan video which 

25 is applied to the A to D converter ADC 1210 in the scan converter board. 

26 The moveable portions in the scan head, either the mirror or the transducer, 

27 are driven by a motor 1340. A tachometer or position sensor 1342 is attached to 

28 the shaft of motor 1340. The output of the position sensor and the control signal 

29 to drive motor 1340 is generated by motor control 1344. Motor controller 1344 

30 obtains the motor on/off signal from the scan converter board. The signal from 

31 position sensor 1342 is conditioned by motor control circuit 1344 and its output 
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1 is designated as motor sequence data applied to the input timing generator 1202 

2 in the scan converter. 

3 Isolation circuit 13 12 could be any type of isolation circuit which filters or 

4 limits the significant drive voltage and separates the return ultrasonic data signals 

5 on line 1350 from pre-amplifier 1314 and video processor 1316. 

6 In operation, the video processor 1 3 1 6 is a series of variable gain amplifiers 

7 that are controlled based upon the analog TGC control signals and gain control 

8 signals developed by the scan converter. 

9 Pulser 1304 is a series of amplifiers and timing chips which are activated 

10 upon receipt of the main bang time control signal. The output of pulser 1304, that 

1 1 is, the exemplary voltage pulse 1306, drives the transducer 1308 in the scan head. 

12 The claims appended hereto are meant to cover modifications and changes 

13 within the spirit and scope of the present invention. 

14 What is claimed is: 
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1 CLAIMS 

2 1. An ultrasound device with a virtual control user interface electronically 

3 coupled to an ultrasound scan head comprising: 

4 a display monitor; 

5 a keyboard; 

6 a personal computer data and communications bus; 

7 a central processing unit (CPU), a memory unit, and an input/output 

8 interface for said display monitor and said keyboard, all physically and 

9 electronically plugged into said bus; 

10 a scan head converter and driver coupled between said bus and said 

11 ultrasound scan head; 

12 a virtual control user interface including a software driven display, obtained 

13 from memory and displayed on said display monitor under the control of said 

14 CPU, revealing images representative of a hardware control configuration for 

1 5 another ultrasound processor; 

16 said images including: 

17 a plurality of gain control tactile user interfaces, 

18 a plurality of ultrasound image enhancement control tactile user 

19 interfaces,and, 

20 at least one focus control tactile user interface, 

2 1 said software driven display having multiple menu levels for display of said 

22 plurality of gain control images, said plurality of ultrasound image enhancement 

23 control images and said focus control image, said software driven display further 

24 configured to reveal images of more than one ultrasound processor; and, 

25 means for controlling said scan head based upon said virtual control user 

26 interface and for processing scan head data signals. 
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